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Abstract 

Normalized eigenvalue counting measure of the sum of two Hermitian (or 
real symmetric) matrices A n and B n rotated independently with respect 
to each other by the random unitary (or orthogonal) Haar distributed 
matrix U n (i.e. A n + U„B n U n ) is studied in the limit of large matrix 
order n. Convergence in probability to a limiting nonrandom measure 
is established. A functional equation for the Stieltjes transform of the 
limiting measure in terms of limiting eigenvalue measures of A n and B n 
is obtained and studied. 
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1 Introduction 

The paper deals with the eigenvalue distribution of the sum of two n x n Her- 
mitian or real symmetric random matrices as n — > oo. Namely we express the 
limiting normalized counting measure of eigenvalues of the sum via the same 
measures of its two terms, assuming that latter exist and that terms are ran- 
domly rotated one with respect another by an unitary or an orthogonal random 
matrix uniformly distributed over the group U(n) or 0(n) respectively. 

One may mention several motivations of the problem. First, it can be re- 
garded in the context of general problem to describe the eigenvalues of the sum 
of two matrices in terms of eigenvalues of two terms of the sum. The latter 
problem dates back at least to the paper of H. Weyl Q, was treated in a 
number of papers, including the recent paper j jlBj ] , and related to interesting 
questions of combinatorics, geometry, algebra etc. (see e.g. || for recent results 
and references). The problem is also of considerable interest for mathematical 
physics because of its evident links with spectral theory and quantum mechanics 
(perturbation theory in particular). 
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It is clear that one cannot expect in general a simple and closed expression 
for eigenvalues of the sum of two given matrices via eigenvalues of terms. Hence, 
it is natural to look for a "generic" asymptotic answer, studying a randomized 
version of the problem in which at least one of the two terms is random and 
both behave rather regularly as n — > oo. Particular results of this type were 
given m (T| |0) where it was proved that under certain conditions the divided 
by n eigenvalue counting measure of the sum converges in probability to the 
nonrandom limit that can be found as a unique solution of a certain functional 
equation. Thus, a randomized version of the problem admits a rather construc- 
tive and explicit solution. These results were developed in several directions 
(see e.g. || - and the recent work Q). Similar problems arose recently in 
operator algebras studies, known now as the free (non-commutative) probability 
(see [^9[ ||^, ||^] for results and references). In particular, the notion of the R- 
transform and the free convolution of measures were introduced by Voiculescu 
and allowed the limiting eigenvalue distributions of the sum to be given in a 
rather general and simple form. From the point of view of the random matrix 
theory the problem that we are going to consider is a version of the problem of 
the deformation (see e.g. for this term) of a given random matrix (that can 
be a non-random matrix in particular) by another random matrix in the case 
when "randomness" of the latter includes as an independent part the random 
choice of the basis in which this matrix is diagonal. We will discuss this topic 
in more details in Section 2. 

In this paper we present a simple method of deriving functional equations for 
the limiting eigenvalue distribution in a rather general situation. The method is 
based on certain differential identities for expectations of smooth matrix func- 
tions with respect to the normalized Haar measure of U(n) ( or 0(n) ) and on 
elementary matrix identities, the resolvent identity first of all. The basic idea is 
the same as in jlT], |2(J : to study not the moments of the counting measure, as 
it was proposed in the pioneering paper by Wigner j35j, but rather its Stieltjes 
(called also the Cauchy or the Borel) transform, playing the role of appropriate 
generating (or characteristic) function of the moments (the measure). However, 
the technical implementation of the idea in this paper is different and simpler 
then in 0, |o| (see Remark after Theorem |J ). 

The paper is organized as follows. In Section 2 we present our main results 
(Th eore m 2.1 ) and give their discussion. In Section 3 we prove Theorems |3.l| 
and |3.2| giving the solution of the problem under the conditions of the uniform 
in n boundedness of the forth moments of the normalized counting measure of 
the terms. These conditions are more restrictive than those for our principle 



result, given in Theorem 2.1. Their advantage is that they allow us to use the 



main ingredients of our approach in more transparent and free of technicalities 
form. In Section 4 we prove Theorem 2.1, whose main condition is the uniform 
boundedness of the first absolute moment of the normalized counting measure 
of one of the two terms of the sum. In Section 5 we study certain properties of 
solutions of the functional equation and of the limiting counting measure. In 
Section 6 we discuss topics related to our main result and our technique. 
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2 Model and Main Result. 



We consider the ensemble of n-dimensional Hermitian (or real symmetric) ran- 
dom matrices H n of the form 

H n = Hi.n + H 2 ,n, (2.1) 

where 

Hi. n — V*A n V n , H 2 , n — U*B n U n . 

We assume that A n and B n are random Hermitian (or real symmetric) matrices 
having arbitrary distributions, V n and U n are unitary (or orthogonal) random 
matrices uniformly distributed over the unitary group U(n) (or over the orthog- 
onal group 0(n)) with respect to the Haar measure, and A„, B n , V n and U n 
are mutually independent. For the sake of definiteness we will restrict ourself to 
the case of Hermitian matrices and the group U(n) respectively. The results for 
symmetric matrices and for the group 0(n)have the same form, although their 
proof is more involved technically (see Section 6). 

We are interested in the asymptotic behavior as n — > oo of the normalized 



eigenvalue counting measure (NCM) N n of the ensemble (2.1), defined for any 
Borel set A C 1 by the formula 

N n (X) = #{A * gA} , (2.2) 
n 

where A; , i = 1, n are the eigenvalues of H n . 

The problem was studied recently J32], |3l[] in the context of free (non- 
commutative) probability. In particular, it follows from results of [ p7| that if 
the matrices A n and B n are non-random, their norms are uniformly bounded 
in n, i.e. their NCM 2Vi )n and N2 tU have uniformly in n compact supports and 
if these measures have weak limits as n — ► oo 

N hn -» N u N 2 , n -» N 2 , (2.3) 



then the NCM (2.2) of random matrix (2.1) converges weakly with probability 



1 to a non-random measure N. Besides, if 



/.:.= / lm 2 >0, (2.4) 



is the Stieltjes transform of this limiting measure and 



/.!'->= / ^ r = l,2, (2.5) 



are the Stieltjes transforms of N r , r = 1, 2 of (2.3), then according to [|19| f(z) 
satisfies the functional equation 

f(z) = h(z + R 2 (f(z))), (2.6) 
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where R2H) is defined by the relation 



MM*))) 



(2.7) 



and is kn own as i?-transform of the measure N2 of ( |2.3| ) (see Remark |3j after 
Theorem 2T and |32], |3(| for the definit ion and properties of this transform 
taking into account that our definition (2.7) differs from that of |3^] by the 
sign). The proof of this result in p7l [HI was based on the asymptotic analysis 



of the expectations rrvi of moments of measure (2.2). Since, according to the 
spectral theorem and the definition (p^), 



mi n) = E{M< n) }, 



M 



{n) 



1 TiH k 

71 ' 



(2.8) 



(n) 

one can study the averaged moments m k by computing asymptotically the 
expectations of the divided by n traces of the fc-th powers of (2.1), i.e. of 
corresponding multiple sums. This direct method dates back to the classic paper 
by Wigner ]35| and requires a considerable amount of combinatorial analysis, 
existence of all moments measures and their rather regular behavior as 

tl — ► 00 to obtain the convergence of expectations ( |2.8p for all integer k and to 
guarantee that limiting moments determine uniquely corresponding measure. 
By using this method it was proved in |27], Jl9 that the expectation of N„ 
converges to the limit, determined by ( |2.6| ) - (2.7) and in I2T 
Var{M< Il) } = E{(Af< Il) ) 2 } 



that the variance 



E 2 {M^ n) } admits the bound 



Var{M< n) } < 



C k 



(2.9) 



where Ck is independent of n. This bound yields evidently the convergence of all 
moments with probability 1, thereby the weak convergence with probability 1 
of random measures ( |2.2D to the non-random limit, determined by ( |2 . 6| ) - (2.7). 
The convergence with probability 1 here and below is understood as that in the 
natural probability space 

n = Y[n n , (2.10) 



where Q n is the probability space of matrices (2.1) that is the product of re- 
spective spaces of A n and B n and two copies of the group U (n) for U n and 
V n . 

In this paper we obtain the analogous result under weaker assumptions and 
by using a method, that does not involve combinatorics. This is because we work 
with the Stieltjes transforms of measures ( |2.2| ) and (2.3) and derive directly the 
functional equations for their limits and the bound analogous to (2.9) for the rate 
of their convergence (rather well known in the random matrix theory, see e.g. 
[ p4| pT[ ) by using certain simple identities for expe ctations of matrix functions 
with respect to the Haar measure (Proposition |3.2| below) and elementary facts 
on resolvents of Hcrmitian matrices. 
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The Stieltjes transform was first used in studies of the eigenvalue distribution 
of random matrices in paper p7[ and proved to be an efficient tool in the field 
(see e.g. g, ^ [□], g [U| Q E§ ^ g ||, ||). We list the properties of the 
Stieltjes transform that we will need below (see e.g.jlj). 

Proposition 2.1 Let m be a non-negative and normalized to unity measure 
and 

r m(dA)^ lmz ^ (2 .ii) 
J A - z 

be the Stieltjes transform of m (here and below integrals without limits denote 
the integrals over the whole axis). Then: 

(i) s(z) is analytic in C\M and 

\s(z)\ < |Im z\-\ (2.12) 



(ii) 
(Hi) 



Im s(z)Im z > 0, Im z =/= 0; 



lim y\s{iy)\ 



(2.13) 



(2.14) 



(iv) for any continuous function if with a compact support we have the inver- 
sion (Frobenius- Perron) formula 



</>(\)N(d\) 



lim — 

e->0 7T 



0(A)Im s(\ + is); 



(2.15) 



(wj conversely, any function verifying (2.1%.) - (2.14) is the Stieltjes transform 
of a non-negative and normalized to unity measure and this one-to-one 
correspondence between measures and their Stieltjes transforms is contin- 
uous if one will use the topology of weak convergence for measures and 
the topology of convergence on compact sets of C \ K for their Stieltjes 
transforms. 

We formulate now our main result. Since eigenvalues of a Hcrmitian matrix 
are unitary invariant we can replace matrices (2.1) by 

H n = A n + U*B n U n , (2.16) 



where A n , B n and U n are the same as in (2.1). However, it is useful to keep in 
mind that the problem is symmetric in A n and B n . We prove 



Theorem 2.1 Let H n be the random n x n matrix of the form (2.1). Assume 
that the normalized eigenvalue counting measures N r n ,r = 1,2 of matrices A n 
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and B n converge weakly in probability as n — > oo to the non-random nonnegative 
and normalized to 1 measures N r , r = 1, 2 respectively and that 

sup [ |A|EAT*„(dA) < mi < oo, (2.17) 

n J 

where N* n is one of the measures Ni jTl or N^ n . Then the normalized eigenvalue 
counting measure N n of H n converges in probability to a non-random nonnegative 
and normalized to 1 measure N whose Stieltjes transform (2.4) is a unique 
solution of the system 

/(z) = /l l z ~7w 

M=h(z-^£) (2.IN) 



m 

= 1-Ax(z)-A 2 (z) 

— z 

in the class of functions f(z) satisfying ( 2.1i ) - \2. l\) and functions A r (z),r — 
1, 2 analytic for Im z ^ and satisfying conditions 

Ai, 2 (z) ^ as Im z -> oo, (2.19) 



where f r (z),r — 1,2 are Stieltjes transforms (2.1) of the measures N r ,r = 
1,2 and E{-} denotes the expectation with respect to the probability measure, 
generated by A n , B„ , U n and V n 

The theorem will be proved in Section 4. Here we make several remarks 
related to the theorem (see also Section 5). 

Remark 1 The historically first example of a random matrix ensemble repre- 
sentable in the form ( 2.16| ) was proposed in Q and has the form 

m 

H m , n = H ,n + nP 4* ' ( 2 - 20 ) 
i=l 

where i?o,n is a non-random n x n Hermitian matrix such that its normalized 
eigenvalue counting measure converges weakly to a limiting nonnegative and 
normalized to 1 measure N , r^, i — l,..m are i.i.d. random variables and 
P qi are orthogonal projections on unit vectors i — l,..m uniformly and 
independently of one another and of {t^}™ 1 distributed over the unit sphere in 
C™ 0. It is clear that the matrix 

m 

E r ^ ( 2 - 21 ) 



1 In fact, in |17| a more general class of independent random vectors was considered, but 
we re stric t ourself here to the unit vectors, in order to have an example of an ensemble of 
form Q ). 
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can be written in the form U*B n U n of the second term of (2.1) or ( |2.16 ). Ac- 
cording to the NCM of random matrix ( |2.21 ) converges in probability as 
n — > oo, to — > oo, m/n — > c > Otoa non-random nonnegative and normalized 
to 1 measure whose Stieltjes transform /mp(z) satisfies the equation 



Jmp{z) 



z + c 



Ta(dr) 



(2.22) 



+ Tf M p(z) / 

where a is the probability law of r, in ( 2.20| ). Assume that a has the finite first 
moment 

J |r|cr(dr) < oo (2.23) 



Then taking ( |2.2l| ) as the second term of ( |2.1|) we get, in view of inequality 
E || |A|iV 2 ,„(dA)} < n" 1 J2 E {N> = 7T E {I T I} < °°> 



the condition^ 2.17 ) of Theorem 2J . Applying then Theorem 2T in which Mz) 
is given by ( |2 . 2 2| ) , we obtain from the two last equations of the system ( [2.18 ) 
that 

Ai(z) f rcr(dr) 



f{z) "J l + rf MP (z)- 

This and the first equation of ( |2.18 ) yield the functional equation for the Stieltjes 
transform of the limiting eigenvalue distribution of ensemble ( [2.20 ) 



f(z) = f [z-c 



rf{z) 



1 



(2.24) 



where fo(z) is the Stieltjes transform of the limiting NCM No of the non-random 
matrix i?o,n- This equation was obtained in 17 by another method, whose main 
ingredient was careful analysis of changes of the resolvent of matrices ( 2.20 ) 
induced by addition of the (TO+l)-th term, i.e. by a rank-one perturbation. This 



allowed the authors to prove that the sequence g^ n (z) 



L Tr(#,,„- 



1, . . . , to converges in probability to the non-random limit f(z,t), z G C\R, t € 
[0, 1], as n — > oo,to — * oo, i — > oo, m/n —> c, i/m — > i, and that the limiting 
function f(z,t) satisfies the quasilinear PDE 



dt 



r(t) df 

'1 + T(t)fdz' 



f(z,0) = f (z), 



(2.25) 



where r(t) is the inverse of the probability distribution ct(t) = < r}. It can 
be shown that the solution of (2.25) at t = 1 coincides with ( 2.20| ) p7| . Equation 
( ^.25 ) with r(t) = const is a particular case of the so-called complex Burgers 
equation appeared in the free probability 132], where the random matrices (2.20) 



provide an analytic model for the stationary processes with free increments, like 
in the conventional probability the heat equation and sums of i.i.d. random 
variables comprise an important ingredient of the theory of random processes 
with independent increments. 
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Remark 2 Consider the ensemble known as the deformed Gaussian ensemble 
& 

H n = H 0<n + M n , (2.26) 

where Hq_ u is a non-random matrix such that its normalized eigenvalue counting 
measure converges weakly to the limit No and M n — {Mjk}™ k=1 is a random 
Hermitian matrix whose matrix elements Mj k are complex Gaussian random 
variables satisfying conditions: 



2w 2 



(2.27) 



Mj k = M kj , E{M ifc } = 0, E{M hkl M j2k2 } 
In other words, the ensemble is defined by the distribution 

P(dM) = Z~ l exp {-^2 TrA/ 2 | AM, (2.28) 

n 

dM = Y[dMjj Yl dReM jk dlmM jk , 
3—i i<i<^< n 

where Z n is the normalization constant. The distribution defines the Gaus- 
sian Unitary Ensemble (GUE) |l8"| . This is why ensemble ( [2.26 ) is called the 
deformed GUE . It is known [|l8| that M n can be written in the form 



U n A n U n j 



(2.29) 



where U n are unitary matrices whose probability law is the Haar measure on 
U (n) and A„ is independent of U n diagonal random matrix whose normalized 
eigenvalue counting measure converges with probability 1 to the semicircle law. 
The Stieltjes transform f sc {z) of the latter satisfies the simple functional equa- 
tion Hi 

f sc (z) = -(z + 2w 2 f sc (z)), (2.30) 
whose solution yields the semicircle law by Wigner 

iV sc (rfA) = (47m, 2 )- V8^ 2 - A 2 x h2v ^, 2v ^](A)dA, (2.31) 

where X[a,b] M ^ s the indicator of the interval [a, b] C R. It is easy to see that 

Ejn^TrM 2 } = 2w 2 < 00. 



Denoting N sc>n the NCM of the random matrices defined by (2.28) we can 
rewrite this inequality in the form 



/CO 
\ 2 V{N sc . n {d\)} < 00. 
-OO 



(2.32) 



Thus, if we use ( [2.29 ) as the second term in ( [?.16j ), it will satisfy condition 
(pTl]) . Taking f sc { z ) a s in ( [2.18 ) we find from the two last equations of 
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the system that /±.%{z) / f (z) = —2w 2 f(z) and then the first equation of (2.18) 
takes the form 

f(z) = f (z + 2w 2 f(z)), (2.33) 

where fo(z) is the Stieltjes transform of the limiting counting measure of ma- 
trices -ffo.n- This functional equation determining the limiting eigenvalue dis- 
tribution of the deformed GUE was found by another method in [g(J ( see a l so 
L2| ) for random matrices ( 2.26| ) in which M n h as independent (modulo the 



Hermitian symmetry conditions) entries, for (2.28) in particular 



Remark 3 Consider now a probability measure m(dX) and assume that its 
second moment m 2 is finite. In this case we can write the Stieltjes transform 
s(z) of m in the form 

S (z) = -(z + S(z))-\ 

where S(z) is the Stieltjes transform of a non-negative measure whose total 
mass is m 2 (to prove this fact one can use, for example, the general integral 



representation [Q for functions satisfying ( 2.13 ) ). Since s'(z) = z 2 (1 + o(l)) 



z — > oo, then, according to the local inversion theorem, there exists a unique 
functional inverse z(s) of s(z) defined and analytic in a neighborhood of zero 
and assuming its values in a neighborhood of infinity. Denote 



£(*(*)) = R m (s) 



(2.34) 



and following Voiculescu |3^] call R m (s) the i?-transform of the probability 
measure m. By using the i?-transforms i?i i2 of measures iVi 2 we can rewrite 



the first two equations of system (2.18) in the form 



Ai, 2 _ 1 



+ Z + ifc,! (/(*)) = + R2,l(f(z)), 



(2.35) 



where R denotes the i?-transform of the limiting normalized counting measure 
N of the ensemble fl2.1| ) (the measure whose Stieltjes transform is /). These 
relations and the third equation of system (2.18) lead to the remarkably simple 
expression of R via R\ and i? 2 



R(f) = R 1 (f) + R 2 (f), 



(2.36) 



that "linearizes" the rather complex system Q2.18p . The relation was obtained 
by Voiculescu in the context of C*-algebra stu dies (see ||^, [50| for results and 
references). Thus, one can regard t he sy stem ( 2.18 ) as a version of the binary 
operation on measures defined by ( 2.36 ) and know n as the non-commutative 
convolution. A simple precursor of relation ( 2.36| ) containing the functional 
inverses of / and fx t % for real z lying outside of the support of Nq in ( 2.24 ) 
was used in jl7j (see also f26|| ) to lo cate the support of N in terms of the 
s uppo rt of No in the case of ensemble ( 2.2C ) . The simplest for m of t he relation 
( [2.36 ) for the case when both measures are semicircle measures ( [2.31 ), i.e. when 



9 



i?i,2 = 2wf 2 fi was indicated in |20 . Formal derivation of relation (2.36) for 
the case then matrices Hi and H2 distributed both according to the laws 



P^(dH) = Z^exp{-nV h2 (H)}dH. 



An) 



(2.37) 



where V\$ : M — > R+ are polynomials of an even degree was given in |37]]. The 
derivation is based on the perturbation theory with respect to the non-quadratic 
part of Vi t 2 and the i?-transform is related to the sum of irreducible diagrams 
of the formal perturbation series. Existence of the limiting eigenvalue counting 
measure for the random matrix ensemble (2.37) was rigorously proved in || for 
a rather broad class of functions V (not necessary polynomials). It was also 
proved that the normalized counting measure (2.2) converges in probability to 
the limiting measure. The form (2.2E) of matrices of ensemble (2.37) can be 
deduced from known results on the ensemble ( p. 37 ) (see e.g.H) in the same way 
as for the GUE ( Og) where V(X) = A 2 /4w 2 (see jl8f). Condition < ^Tf\ ) follows 
from results of pi 1221. Thus we can apply Theorem 2.1 to obtain rigorously 



relation ( |2.36|) in t he case when matrices H r ,r = 1,2 in ( |2.l| ) are distributed 
according to ( p. 37 ). 



Remark 4 The problem of addition of random Hermitian (real symmetric ma- 
trices) has a natural multiplicative analogues in the case of positive defined 
Hermitian (real symmetric) or unitary (orthogonal) matrices. Namely, assuming 
that A n and B n are positive defined matrices and U n is the unitary (orthogonal) 
Haar distributed random matrix we can consider the positive defined random 
matrix 

H n = A)l 2 U* n B n U n A)l 2 . (2.38) 

Likewise, if S n and T n are unitary (orthogonal) matrices and and U n is as above 
we can consider the random matrices 



V n = S n U*T n U n . (2.39) 

In this case the normalized eigenvalue counting measure is defined as n~ l times 
the number of eigenvalues belonging to a Borcl set of the unit circle. 



In both cases (2.38) and (2.39) one can study the limiting properties of 
the NCM's of respective random matrices provided that the "input" matrices 
A n , B n , S n and T n have limiting eigenvalue distributions. The first examples of 



ensembles of the above forms as multiplicative analogues of the ensemble (2.20) 
were proposed in ^7\ , where the respective functional equations analogous to 
( p. 24 ) were derived. A general class of the random matrix ensembles of these 



forms were studied in free probability j29|, |32], |2j] , where the notions of the S - 
transform and the free multplicative convolution of measures were proposed and 
used to give a general form of the limiting eigenvalue distributions of products 
( p. 38 ) and ( |2.39| ). It will be shown in the subsequent paper ||^| that a version of 



the method of this paper leads to results, analogous to those given in Theorem 
2.1 above. 
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3 Convergence with Probability 1 for non- Random 



A n and B r 



As the first step of the proof of Theorem 2.1 we prove the following 



Theorem 3.1 Let H n be the random nxn matrix of the form (2.1) in which A n 
and B n are non-random Hermitian matrices, U n and V n are random indepen- 
dent unitary matrices distributed each according to the normalized to unity Haar 
measure on U (n). Assume that the normalized counting measures N r n , r = 1, 2 
of matrices A n and B n converge weakly as n — > oo to nonnegative and normal- 
ized to 1 measures N r ,r = 1,2 respectively and that 



sup 



X 4 N r 



i(d\) = m4 < oo, r = 1, 2. 



(3.1) 



Then the normalized eigenvalue counting measure (2J<) of H n converges with 
probability 1 to a non-random and normalized to 1 measure whose Stieltjes trans- 
form (2.4) is a unique solution of the system (2. IS) in the class of functions 
f(z), A r (z),r = 1,2 analytic for Im z / and satisfying conditions (2.11)- 



(2.14) and (2.1L) respectively 



Remark 1 The theorem generalizes the results of |27j 
dition that supports of the NCM N riTl ,r = 1,2 of A r , 
bounded in n. 



proved under the con- 
and B n are uniformly 



Remark 2 By mimicking the proof of the Glivenko - Cantelli theorem (see e.g. 
[[L6|), one can prove that the random distribution functions N n (\) = N n Q — 
oo, A[) corresponding to measures ( |2.2| ) converge uniformly with probability 1 
to the distribution function N(X) = NQ — oo, A[) corresponding to measure A^: 

P{ lim sup \N n (X) - N(X)\ = 0} = 1. 

n-Kx> AeR 

We present now our technical means. First is a collection of elementary facts 
of linear algebra. 

Proposition 3.1 LefM. n be the algebra of linear transformations ofC n in itself 
(nxn complex matrices) equipped with the norm, induced by the Euclidean norm 
o/C". 

We have : 

(i) if M £ M n and {Mjk}™ k=1 is the matrix of M in any orthonormalized 
basis ofC n , then 

\M jk \ < ||M||; (3.2) 
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(ii) if TrM = ]T then 

3 = 1 

\TiM l M 2 \ < (TrMiM 1 *) 1/2 (TrM 2 M 2 *) 1/2 , (3.3) 

where M* is the Hermitian conjugate of M, and if P is a positive defined 
transformation, then 

|TrMP| < ||M||TrP; (3.4) 

(Hi) for any Hermitian transformation M its resolvent 

G(z) = (M - z)- 1 (3.5) 

is defined for all non-real z, Im 0, 

||G(z)|| < |Im z]- 1 (3.6) 

and if {Gjk(z)}™ k=1 is the matrix of G(z) in any orthonormalized basis 
of C" then 

\G jk (z)\ < |Im zl" 1 ; (3.7) 

(iv) if Mi and M 2 are two Hermitian transformations and G r (z),r = 1,2 are 
their resolvents, then 

G 2 (z) = d(z) - Gi(z)(M 2 - M 1 )G 2 (z) (3.8) 

(the resolvent identity); 

(v) if G(z) — (M — z)^ 1 is regarded as a function of M, then the derivative 
G'{z) of G(z) with respect to M verifies the relation 

G'(z) ■ X = -G{z)XG{z) (3.9) 

for any Hermitian X e M„, and, in particular, 

||G'(z)||<||G(z)|| 2 <|Im z\- 2 (3.10) 

Now is our main technical tool. 

Proposition 3.2 Let $ : M„ — > C be a continuously differentiable function. 
Then the following relation holds for any M € M n and any Hermitian element 
X e M„: 

J &{U*MU) ■ [X,U*MU]dU = 0, (3.11) 

U(n) 

where 

[Mt ,M 2 ] = M 1 M 2 -M 1 M 2 (3.12) 
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is the commutator of Mi and M2 and the symbol 

..dU 



(3.13) 



U(n) 



denotes the integration over U (n) with respect to the normalized Haar measure 
dU. 



Proof. To prove ( |3.1l| ) we use the right shift invariance of the Haar measure: 
dU — d(UUo), VJ7o G U(n) according to which the integral 



J <S>(e- isX U*MUe i£X )dU 



U(n) 

is independent of e for any Hermitian X G M„. Thus its derivative with respect 



to e at e — is zero. This derivative is the l.h.s. of (3.11) 



Proposition 3.3 System (2.18J has a unique solution in the class of functions 
f(z), Ai 2 (z) analytic for Im z =/= and satisfying conditions (2.1£)-(2.14) and 

Proof. Assume that there exist two solutions (/ , Aj^ 2 ) and (/ ,A 12 ) of the 



system. Denote Sf = f — / , JA1.2 = A 12 — A 12 - Then, by using (2.18) 
and the integral representation Q2.5| ) for fi^, we obtain the linear system for 
5(f) = zdf, and for SAi^ 



where 



S(j){l-a 1 {z)) + b 1 (z)SA 1 =0, 
54>{\-a 2 {z)) + b 2 {z)5A 2 =0, 
5<t> - 8 Ax - 8A 2 = 0, 



01 - -^77/2, 61 = ^2, h = h(z- AJf\z-A[/f 



h{z',z") 



N 2 {d\) 



(3.14) 



(3.15) 



(3.16) 



{\-z'){X-z"y 

and a 2l b 2 can be obtained from a\ and 61 by replacing N 2 and Ai by N\ and 
A2 in above formulas. For any yo > consider the domain 



£(j/o) = {z e C : |Im z\ > y , |Re «| < |Im z|}. 



(3.17) 



If s(z) is the Stieltjes transform (2.11) of a probability measure m, then we have 
for z £ E(yo), 



Am(dA) 



A 



\\<M \\\>M 



< 



M 



i(dA), 



|A|>M 
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i.e. 



zs(z) = — 1 + o(l), z —> 00, z € E(yo). 



(3.18) 



Analogously, by using this asymptotic relation and condition ( 2.19| ) we obtain 
that for z — > 00, z £ E(yo) 

z 2 I la {z) = 1 + o(l), a ia (z) = o(l), b h2 (z) = -1 + o(l). 



Thus the determinant b\b 2 + 61 + &2 — («2&i + a A ) of s ystem ( 3.14 ) is equal 
asympto tical ly to —1. We conclude that if yo in ( 3.17 ) is big enough, then 
system ( |3.14 ) has only a trivial solution, i.e. system (|2. 18 ) is uniquely soluble. 



In what follows we use the notation 

J ...dU =(...) 

U{n) 



(3.19) 



Proof of Theorem 3.1. Because of unitary invariance of eigenvalues of a 
Hermitian matrices we can assume without loss of generality that the unitary 



matrix V in (2.1) is set to unity, i.e. we can work with the random matrix 
( |2.16 ). We will omit below the subindex n in all cases when it will not lead to 
confusion. Write the resolvent identity fl3.8|) for the pair (H\ , H) of (JO) : 



G(z) = G 1 (z)-G 1 (z)H 2 G(z), 



(3.20) 



where 



G(z) = (ifi +H 2 - z)-\ Gx(z) - (ifi - z)-\ 
Consider the matrix (g n (z)G(z)) , where 



g n (z) = — TrG(z) 



N n (d\) 
X-z • 



Im z =/= 



(3.21) 



is the Stieltjes transform of random measure (2.2). The resolvent identity (3.20) 
leads to the relation 



(g n {z)G{z)) = < fln (z))Gi(z) - G x (z){g n (z)H 2 G{z)). 



(3.22) 



By using Proposition 3.2 with the matrix clement ({Hi + M — z) x ) ac as $(M) 
we have in view of (3.9) and (3.11) - (3.12) 



((G[X,H 2 ]G) 



0. 



Choosing the Hermitian matrix X with only (a, 6)-th and (b, a) non-zero entries, 
we obtain 

(G aa (H 2 G) bc ) = ((GH 2 ) aa G bc ). (3.23) 
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Applying to this relation the operation n 1 ^ and taking into account the 

a=l 



definition ( 3.21 ) of g n (z) we rewrite the last relation in the form 

(g n (z)H 2 G(z)) = (S 2 , n (z)G(z)) 1 

where 

&,„(*) = -TtH 2 G{z). (3.24) 
n 

Thus we can rewrite ( |3.22| ) as 

(g n (z)G(z)) = {g n {z))G x (z) - G 1 (z)(6 2 , n (z)G(z)). (3.25) 
Introduce now the centralized quantities 

9n( z ) = 9n{z) - fn{z), 5° 2n (z) = 6 2 , n (z) ~ &2,n(z), (3.26) 

where 

f n (z) = (g n (z)), A 2 ,„(z) = {5 2 , n {z)). (3.27) 
With these notations ( |3.25 ) becomes 



f n (z)(G(z)) = U(z)Gi{z) - A 2>n (z)G 1 (z)(G(z)) + Ri, n (z), (3.28) 

where 

fli,n(*) - -(g°(z)G(z)) - G 1 (z)(Sl n (z)G(z)). (3.29) 

Besides, since 

n^TrH 2 = n- 1 Tr(i/i + H 2 ) 2 < 2n- 1 Tri? 1 2 + 2n- 1 Tr J fff = 
= 2 J A 2 iVi,„(dA) + 2y A 2 7V 2i „(dA) < 4m 2 < 4m4 /2 , 

we have 



Thus 

/• JV w (dA) 1 ^ 

ffnC*) = / -: = ^gn{z), 

J A- z z 

where 

^ , /" AA^(dA) 
j {X-z)z 



In view of (3.31) 



-1 1/4 
«4 ' 



(3.30) 



^ 2 = sup(n" 1 TrH 2 ) = sup j X 2 N n (d\) < 4m 2 < 4m 1 / 2 < oo. (3.31) 

n n J 



\zg n (z)\ < |Im y* |A|AT„(dA) < |Im ar]- 1 ^ 
i.e. the asymptotic relation 

9n - 1 (z) = -^l + 0^jj,lm^« (3.32) 
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holds uniformly in n. We have also the simple bound 

\g n {z)\ < \lmz\~ 1 



(3.33) 



following from (3.4) and (3.7) and, in addition, according to Proposition |3 . 1| and 
( 13.240 , the bounds 

\S 2 , n {z)\<ml /A \Imz\- x , (3.34) 



z8 2 , n {z) = n~ 1 TrH 2 zG(z) = rC lr TiH 2 (-l + HG{z)). 



(3.35) 



Hence, in view of ( 3.31 ) 

\zfi*,n{*)\ ^ (n^TrHi) 1 / 2 + (n- 1 TTH 2 ) 1 / 2 (n^ 1 TTH 2 G(z)G*(z)) 1 / 2 < 
< ml /4 + 2m 1 / 2 /y , 



i.e. zS2, n (z) is uniformly bounded in n. 

As a result of above bounds we have for |Im z\ > yo uniformly in n 



(3.36) 



\\A 2in (z)f- 1 (z)G 1 (z) 



O 



,yo -> oo 



i.e. the matrix 1 — A 2<n (z)f n (z)Gi(z) is invertible uniformly in n and there is 
yo independent of n and such that for |Im z\ > j/q 



\\(l + A 2 , n (z)f- 1 (z)G 1 (z))- 1 \\<2. 



(3.37) 



Thus (3.28) is equivalent to 



(G(z)) = (l + A 2 ,„(z)/- 1 (z)G 1 (z))- 1 G 1 (z)+ 
(1 + A 2 , n (z)f- 1 (z)G 1 (z))- 1 f- 1 (z)R 1 , n (z) 



or to 



(G(z)) =G 1 (z- A 2 , n {z)f- l {z)) + (1 + A 2>n (z)f- 1 (z)G 1 (z))- 1 f- 1 (z)R 1 , n (z). 
Applying to this relation the operation n _1 Tr we obtain 

fn(z) = h, n (z ~ A 2 , n (z)/- 1 (z)) + ri , n {z), (3.38) 

where 



/i,n(z) =n- 1 TrG 1 (z) 



X-z 



(3.39) 



is the Stieltjes transform of the normalized counting measure of H\ n in ( |2.1 
and 



ri, n (z) = n- x Tr(l + A 2 , n (z) f~ x (z)Gi(z))- 1 f~ x (z)R 1 , n (z), 



(3.40) 



where Ri <n (z) is defined in ( 3.29| ). We show in the next Theorem 3.2 that there 
exists a sufficiently big yo > and C(yo) > 0, both independent of n and such 
that if z <E E(yo), where E(yo) is defined in (3.17), then the variances 



v 1 {z) = (\g°(z)\ 2 ), v 2 (z) = (\6° 2 Jz)\ 2 ) 



(3.41) 



16 



admit the bounds 



vi(z) < 



C(yo) 



v 2 {z) < 



C(y ) 



(3.42) 



These bounds, Proposition (3.37), and Schwartz inequality for the expecta- 
tion (...) imply that uniformly in n and in z £ E(yo) 

KnWI < ^^(l + Z/ - 1 )(|/- 2 (z)n- 1 TrG(z)G*(z)| 2 )^. 



In view of (3.27), (3.32) and the identity zG{z) = — 1 + HG(z) we have 
f-\z)G{z) = -z(l + 0(y^))G(z) = (1 + 0(y^))(l - HG{z)), 
and since, by (fj), (|D|) and ( |Oo| ) 



\(n- 1 TrHG(z))\ < % 1 { n - 1 TrH 2 ) < 



< 2m 



1/4 

4 yo 



\(n- 1 TiH 2 G(z)G*{z)) \ < 4m^ /2 % ; 



we obtain that for z G E(yo) 



kl,n(«)| < 



<?i(y ) 



(3.43) 



where Ci(j/o) is independent of rt and i s bou nded in yo- 

Furthemore, the bounds ( 3.33 ) and ( 3.34 ) imply that sequences {f n (z)} and 
{A2 !rl (z)} are analytic and uniformly in n bounded for |Im z\ > yo > 0. Thus 
the sequences are compact with respect to uniform convergence on compacts of 
the domain 

D(y ) = {z G C : |Im z\ > y > 0}. (3.44) 

In addition, according to the hypothesis of the theorem, the normalized counting 
measures N\ >n of matrices H\ n converge weakly to a limiting probability mea- 
sure Ni Thus, their Stieltjes transforms (3.39) converge uniformly on compacts 
of (3.44) to the Stieltjes transform /i of N±. Hence, if yo > is large enough, 
there exist two analytic in (3.44) functions / and A2 verifying the relation 



/(*) = h[z- 



A 2 (z) 
/(*) 



|Im z\ > yo- 



This is the first equation of system (2.18). The second equation of the system 
follows from the argument above in which the roles Hi and H 2 are interchanged, 
in particular the quantity (n^ 1 TiHiG(z)} is denoted A x „(z). As for the third 
equation, it is just the limiting form of the identity 



l Tr{H hn + H 2>n -z)G(z)) = 1. 



(3.45) 



Thus, we have derived system (2.18). Its unique solubility in domain (3.17) 
where yo is large enough is proved in Proposition 3.3. Besides, all three functions 
f n , A r! „,r = 1,2 defined in (3.27) are a priory analytic for |Im z\ > 0. Thus, 
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their limits /, A r ,r = 1,2 are also analytic for non-real z. In view of the 
weak compactness of probability measures and the continuity of the one-to-one 
correspondence between nonnegative measures and their Stieltjes transforms 
(see Proposition |2.1| (v)) there exists a unique nonnegative measure N such that 
/ admit the representation (2.4). The measure TV is a probability measure in 
view of ( p2| ) and.(fu|). 



We conclude that the w hole sequence f/ w } of expectations (3.27) of the 
Stieltjes transforms g n ( 3.21 ) of meas ures ([2T4 ) converges uniformly on compacts 
of D(y$), where -D(yo) is defined in (3.44), to the limiting function / verifying 
( [2.18 ). This result, Theorem ^2 and the Borel-Cantelli lemma imply that the 



sequence {g n (z)} converges with probability 1 to f(z) for any fixed z £ D(yo). 
Since the convergence of a sequence of analytic functions on any countable set 
having an accumulation point in their common domain of definition implies 
the uniform convergence of the sequence on any compact of the domain, we 
obtain the convergence g n to / with probability 1 on any compact of D(yo). 
Due to the continuity of the one-to-one correspondence between probability 
measures and their Stieltjes transforms (see Proposition |2.l| (v)) the normalized 
eigenvalue counting measure (2.2) of the eigenvalues of random matrix ( |2.l| ) 
converge weakly with probability 1 to the nonrandom measure N whose Stieltjes 



transform (2.4) satisfies (2.18) 



Theorem 3.2 Let H n be the random matrix of the form i\) satisfying the 
condition of Theorem \3.\. Denote 



g n (z) = n- lr Ti{H n - z)~ l , 5 r<n [z) = n - lr TrH rin (H n - z)~ 1 ,r= 1,2. (3.46) 

Then there exist yo and C(ya), both positive and independent of n and such that 
the variances of random variables (3.4-6) admit the bounds for |Im z\ > yo 



(\g n (z)-(g n (z))\ 2 )< 



C(y ) 



(|<5 r ,„0z)-(<Mz)>| 2 ) < 



C(yo) 



1,2, 



(3.47) 
(3.48) 



if z S E(y ), where E(y ) is defined in (3.17) 



Pro of. Because of the sy mme try of the problem with respect to H\ and H2 
in (2.1) it suffices to prove ( 3.48j ) for, say, 62, n (2). Besides, we will use bellow 
the notations g(z) and S(z) for g n (z) and 52, n (z) and the notations 1 and 2 
for two values Z\ and Z2 of the complex spectral parameter z. We assume that 
|Im 2f 1)2 | > yo > 0. 

we will 



We will use the same approach as in the proof of Theorem 3.1 



derive and study certain relations obtained by using Proposition |3_J and the 
resolvent identity. 

Consider the matrix 

Vi = (ff°(l)G(2)), (3.49) 
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where g°(l) — g(l) — (.9(1))- Its clear that n 1 TrVi for Z\ = z and z 2 — z is the 
variance ( pTl ), that we denoted Vi(z) in ( |3.4l| ): 

(\g°(z)\ 2 ) = n^TrViU^,^ = Vi(z). (3.50) 



In view of the resolvent identity (3.20) for the pair (Hi, H) we have 

Vi = -Gi(2)W, (3.51) 

W = (g°(l)H 2 G(2)). (3.52) 
Applying Proposition [5^ to the function 

S(M) = G° a (l)(MG(2)) cd , 

where G(z) = (#1 + M - and 

G°(z) = G(z) - (G(z)) = 

(H x + M - z)- 1 - [ (Hi + U*BU - z)- 1 dU, 

JU(n) 

we obtain the relation 

-((G(l)[X,H 2 ]G(l)) aa (H 2 G(2)) cd ) + (G° aa (l)([X,H 2 ]G(2)) cd y 
-(G aa (l)(H 2 G(2)[X,H 2 ]G(2)) cd )=0, 

where the operation [...,...] is defined in ( |3 . 12 ) . Choosing as X the Hermitian 
matrix having only the (c, j)-th and (j, c) non-zero entries, we obtain from the 
above relation the following one: 

-(G ac (l)(H 2 G(l)) ja (H 2 G(2)) cd ) + ((G(l)H 2 ) ac G ja (l)(H 2 G(2)) cd ) + 

+(G° aa (l)5 cc (H 2 G(2)) jd ) - (G° aa (l)(H 2 ) cc G jd (2))- 
-(G° aa (l)(H 2 G(2)) cc (H 2 G(2)) jd ) + (G° aa (l)(H 2 G(2)H 2 ) cc G jd (2)) = 
Applying to this relation the operation n _1 ^ and taking into account that 

ac 

g° = n- 1 J2G° aa , 
a 

we have 

n- 2 ([G 2 (l), H 2 ]H 2 G(2)) + (g° (1)H 2 G(2)) + 
+(g°(l)k(2)G(2)) (g°(l)8(2)H 2 G(2)) = 0, 

where 

k(z) = n- 1 TrK(z),K(z) = BGu(z)B - B, G v (z) = UG(z)U* . (3.54) 



Introducing the centralized quantity (cf.(3.26)) 

k°=k-(k), (3.55) 
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and using our notations ( |3.24 ) and ( |3.27 ), we can rewrite (3.53) as 

(1- A(2))W = -(fc(2))Vi + .R, (3.56) 

where 

R = (g°(l)5°(2)H 2 G(2)) - (g° (l)k° (2)G(2)) - T u (3.57) 

and 

Ti =n- 2 ([G 2 (l),H 2 ]H 2 G(2)). 

In view of the uniform in n bound ( [3.36| )), the function 1 — A(z) is uniformly 
in n bounded away from zero. Thus we have from ( |3~5l"l ), ( |3~52; ) and ( p6| ) 

Vi = (1 - (fc(2))(l - A(2))- 1 G 1 (2))" 1 (1 - A(2))- 1 G 1 (2)i?. (3.58) 



According to (3.54), ( |3.6D and ( |3.1[ ), we have uniformly in n 

\K Z )\ < Vq 1 ^ 1 Tr-B 2 + |n- lr rrS| < % + m 1 ^ < oo. (3.59) 



This bound and universal bound (3.6) imply that the matrix (1 — (k(z))(l — 
A(z)) _1 Gi(z)) is uniformly in n invertible if |Im z\ > y$ and yo is large enough, 
and hence the matrix 

Q = (1 - (k(z))(l - A(z))~ 1 Gi{z))~ 1 (1 - A(z)) _1 Gi(z) 

admits the following bound for |Im z\ > yo and sufficiently large yo 



IIQII<-> 



(3.60) 



where G is an absolute constant. 

z\ = z. z 2 = ~z and applying to this rel ation the 



Setting now in (3. 

era 
tl 

(!) 



operation n : Tr we obtain in the l.h.s. the variance v\{z) beca use o f ( 3.5C ). As 
for the r.h.s., its terms can be estimated as follows in view of ( 3.57 ): 



\(g (l)S°(2)n- 1 TvQH 2 G(2))\ < a 12 {y )v\ /2 v l 2 /2 , 



wher e v 2 is defined in ( 3.41 ) and because, according to ( 3.1 
and ( |3.60D , 

\n- 1 TrQH 2 G(2)\ < { n - 1 TrQ*Q) 1 / 2 {n- 1 TrH 2 G(2)G*{2)) 1 / 2 < 
< Cy^m 1 / 4 = a 12 (y); 



(3.61) 



(ii) 



where 
because 



|( 5 (l)F(2)n- 1 TrQG(2))| < a^{y )v\ /2 vl /2 , 
v 3 = {\k°(z)\ 2 ) 



|n- 1 TrQG(2)| < (n- 1 TrQ*Q) 1 / 2 (n- 1 TrG(2)G* (2)) 1 / 2 < 



< Cy = a 13 (y ); 



(3.62) 

(3.63) 
(3.64) 

(3.65) 
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(iii) 



1/2 -4 -2 _ Pl(Vo) 



|n- J Tr(Q[G^(l),i/ 2 ]i? 2 G(2))| < Cmfl/o 
Thus we obtain the inequality 

. / x 1/2 1/2 1/2 1/2 /3l(j/o) 

«i < ai2(j/o)«i u 2 +ai3(2/oJ«i «V H h~ ■ 



(3.66) 



where a%2, ai3 and /3i are independent on n and vanish as j/o ~~ * 00 • 

Now we are going to derive analogous inequalities for v 2 and U3 defined in 
( [3.41 ) and in (3.64) and to obtain the system 



«%< £ a^r + T^^ 1-2,3. 



(3.67) 



To get the second inequality of the system we consider the matrix (cf. ( |3.4S| )) 

V 2 = (6°(1)H 2 G(2)). (3.68) 

Applying to V 2 operation n _1 Tr and setting z\ = z, z 2 = ~, we obtain the 
variance v 2 of (3.42). On the other hand, using Proposition 3.2 for the function 

$(M) = (MG(l))° aa (MG(2)) cd , 

we obtain, aft er pe rforming in essence the same procedure as that used in the 
derivation of ( 3.53 ), in particular, choosing the Hermitian matrix X with only 
the (c, j)-th and (j, c) non-zero entries, 



where 



v 2 = -<s(2)5°(l)fc(2)) + (6°(1)6 2 (2)) - T 2 , 
T 2 = (n- 3 Tr({Gu(l),K(l)}BG(2))) 



(3.69) 
(3.70) 



and K(z), k(z) are defined in (3.54). Using again centralized quantities (3.26) 
and (3.55), we can write 



and 



(g(2)5°(l)k(2)) = (g°(2)6°(l)k(2)) + (g(2))(6°(l)k°(2)) 



(6°(1)6 2 (2)) = (5° (1)6° (2)6(2)) + (6° (1)6° (2)) (6(2)). 



Thus, in view of ( 3.33 ), ( 3.34 ), ( p.59[ ), and Schwarz inequality we have the 
bounds 



and 



(g(2)6°(l)k(2)) < v^v^ml/^l + m^V) + "a'W \ 



(6°(1)6 2 (2)) <2v 2 ml / V- 
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These bounds and analogousl y obta ined bound for T2 in ( 3.70 ) lead for m]/ 4 y 
1 /4 to the second inequality ( 3.67 ) , in which 



< 



0:21(2/0) = 4m 1 / 4 , a 23 (yo) 



1/4 



Vo 



(3.71) 



To obtain the third inequality of ( p. 67 ) we may use the same scheme as above 
applied to the matrix V 3 = (k°(l)K{2)} (cf. (fO|) and (j3 68|)). However this 
requires rather tedious computations and the existence of the uniformly bounded 
in n sixth moment mg of the measure A^.n- For this reason we consider the 
quantity 



l Tt{BG u {\)B)°G u {2)B) 1 



(3.72) 



where Gu(z) is defined in ( 3.54 ). As before we would like to obtain for this 
quantity a certain relation, basing on the invariance of the Haar measure with 
respect to the group shifts. To this end we will introduce the following function 
of the unitary matrix U : 



(BUG(l)U*B)° aa (UG(2)U*B] 



where G(z) = {H\+U* BU—z) 1 and we will use the analogue of (3.11) obtained 
from the left shift invariance of the Haar measure. This leads to the relation 
(cf. ( |3~53| ) and fl3~69| )) 



(k°(l)g(2)K(2)) + (k°(l)S(2)Gu(2)B) - (k°(l)Gu(2)B) - T 3 = 0, 
where 



(3.73) 



! (G U (1)BK(1)G U (2)B - K{1)BG U {\)G U {2)B) 



We multiply ( 3.73| ) by B from the left and introduce again the centralized quan- 
tities g°, 8° and k° defined in ( |3.26D and fl3.55| ). We obtain 

(1 - A(2) - f{2)B){k°{l)K{2)) = -(k°(l)g°(2)BK(2)) + 
+ (k°{l)S°(2)BG u (2)B) + BT 3 . 



In view of ( 3.32 ) and ( 3.36 ) the imaginary part of the function 1 — A(z) is 
uniformly in n bounded away from zero if |Im z\ is large enough. Since B is a 
Hermitian matrix, the matrix 



admits the bound 
\\S\\ = \f{2)\-'.\\{{l 



S = (1 - A(2) - f(2)B) 



A(2))r i (2)-i?r i n<i/(2)r 1 



(3.74) 



Im 



1-A(2) 



/(2) 



By using ( |3 . 28 ) and (3.34) we find that for z € E(yo), where E(yo) is defined in 
( |3.17 ) with sufficiently big yo, we have the uniform in n inequality |/(2)Im(l — 
A(2))/" 1 (2)| > 1/2, i.e. 

||S||<2. (3.75) 
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This leads to the relation 



V 3 = (k°(l)K(2)) = -(k°(l)g°(2)SBK(2))+ 
+ (k°{l)5°{2)SBG u {2)B) + SBT 3 . 



(3.76) 



We apply to this relation the operation n _1 Tr, set z\ — z, z 2 — ~z and estimate 
the contribution of the two first terms of the r.h.s. as ( |3 . 76 ) as above, using in 
addition (|3.75 ). We obtain 



\n- lr YYSBK(2)\ < 4ml /2 = a 31 (y ), 
\n- l TiSBGu(2)B\ < Am^y^ 1 = a 32 (y ). 



(3.77) 



To estimate the third term of the r.h.s. of (3.76) we use the identity 

SB = -r 1 (2) + (1 - A(2))/- 1 (2)5, 

the asymptotic relations (|3.32[ ) and ( [3.34 ) and the bound ( |3.75| ). This yields 
the bound < 4yo- By using this bound and the same reasoning as in 

obtaining other bounds above, we obtain 

Cm 4 _ fa 



^TrSBTol < 



where C is an absolute constant. 
Let us introduce new variables 



1/2 1/ £ L/ Z / - , 

ui = 2/0^1 , u 2 = v 2 ' , u 3 = v 3 ' (3.78) 
Then we obtain from ( 3.67 ) and ( 3.62 ), ( 3.65| ), ( 3.71 ), and (3/77) the system 

3 



Vln 2 



1/2 



1/2 



< E 

i=i,i^i 



n 2 



(3.79) 



where bij are 



in which the coefficients {a.y, i ^ j} have the form cij 
bounded in y<j and in n as yo — + oo and n — > oo. By choosing yo sufficiently big 
(and then fixing it) we can guarantees that < a%j < 1/4, i ^ j. Thus summing 
the three relations ( 3.79| ) we can write the result in the form (au, u) < "f/n 2 



where 7 = 71 + 72 + 73 and (a). 



(1 - 5ij)/4,i, j = 1,2,3. Since the 



minimum eigenvalue of the matrix a is 1/2, we obtain from (3.78)bounds (3.47) 
and (0§).B 



4 Convergence in Probability 



In this Section we prove Theor em (2.1[ Since, according to Theorem [3J the 
randomness of U n in (2.1) (or ( 2.1 6| ) ) provides already vanishing the variance 
of the Stieltjes transform of the NCM (2.2), we have only to prove that the 
additional randomness due to the matrices A n and B n in ( |2.lD does not destroy 
this property. We will prove this fact first for A n and B n whose norms are 
uniformly bounded in n (see Lemma 4.1 below ), and then we will treat the 
general case of Theorem [2.1| by using a certain truncating procedure. 
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Proposition 4.1 Let {m n } be a sequence of random non-negative unit mea- 
sures on the line and {s n } be the sequence of their Stieltjes transforms (2.11). 
Then the sequence {m n } converges weakly in probability to a nonrandom non- 
negative unit measure m if and only if the sequence {s n } converges in probability 
for any fixed z belonging to a compact K C {z £ C : Imz > 0} to the Stieltjes 
transform f of the measure m. 



Proof. Let us prove first the necessity. According to the hypothesis for any 
continuous and having a compact support function ip(X) we have 



lim P 

n — >oo 



(p(X)m(d\) — / ip(X)m n (dX) 



> e \ =0. 



(4.1) 



Let x(X) be a continuous function that is equal to 1 if |A| < A and is equal to 
if |A| > A + 1 for some A > 0. Then 



\s(z) - s n (z)\ < 



x(X)m(dX) 

X-z 



x(X)m n (dX) 



X-z 



min{dist{z, ±A}} 



According to fl4.l| ) the first term in the r.h.s. of this inequality converges in 
probability to zero. Since A is arbitrary, we obtain the required assertion. 
To prove sufficiency we assume that for any z£i( 



lim P{\s(z) - s n (z)\ > e} =0. 



(4.2) 



This relation and the inequality (cf. ( 2.12 )) 

|s„(z)| < max |Imz| _1 = y^ 1 < oo (4.3) 

zilK 

imply that 

lim E{\s{z) - s n {z)\}=0, (4.4) 

71 — >00 

i.e. the sequence {s n (z)} converges to zero in mean. We have also the inequality 



\s n (z)\ <y 2 < 



(4.5) 



Inequalities (L3) and ( |4.5| ) imply that the sequence {s n }^Li of random analytic 
functions is uniformly bounded and equicontinuous. Thus, for any r\ > we 
can construct in K a finite 77-network, i.e. a set {^i}?^ such that for any 
z £ K there exists zi satisfying the inequality \z — zi\ < r\. Then we have for 
4> n (z) = s n (z) — s(z), Si — {z : \z — zi\ < ?y}, and rj = Vqe/2, where e is arbitrary 



p('f) 



sup \<t> n {z)\ 

K 



max sup \(f> n {z)\ < e + \(j) n (zi)\, 
i=i...p(v) zexns, 
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and hence 



E{sup \<p n (z)\} < e + V E{|0„(z ; )l}- 



This inequality and (4.4) imply that 



lim E{ sup \s{z) - s n (z)\} =0. 



(4.6) 



Assume now that the statement is false, i.e. the sequence {m n } does not 
converges weakly in probability to to. It means that there exists a continuous 
function (p of a compact support, a subsequence {nk} and some s > such that 



lim P 

rifc — >oo 



tp(\)m(d\) - / ip(\)m nk {d\) 



> e \ =£ > 0. 



(4.7) 



On the other hand, we have from (4.6) and the Tchcbyshcv inequality that for 
any r there exists an integer n(r) such that for n > n(r) 



P <! sup \<j> n (.z) 



< r 



> l-€/2. 



(4.8) 



Hence, one can select from the sequence {n^} a subsequence {rifc/} such that 
inequalities (4.7) and (4.8) are both satisfied. Denote by A and by B the events 
whose probabilities are written in the l.h.s. of (4.7) and ( |4.8| ). Then P{^4nS} > 
P{yl}+ P{$} — 4 > ^/2. Hence, for any ny there exists a realization u> n > 
belonging to the both sets A and B, i.e. for which the both inequalities 



tp(\)m(dX) — / ip{\)m n i (dX) 



> e, sup \<j}„' (z)\ < r 



-1 



(4.9) 



are valid. In view of the compactness of the family of the random analytic 
functions {s n } with respect to the uniform in K convergence and the weak 
compactness of the family of random measure {m n } there exists a subsequence 
{n k } of {n fc } and a subsequence of realizations {u n '^} such that the subsequence 
{m n »} corresponding to these realizations converges weakly to a certain measure 
m and we have in view of (4.7) 



<p(\)m(d\) - / ip{X)m{d\) 



> e > 0. 



(4.40) 



On the other hand, in view of (^^) and the continuity of the correspondence 
between measures and their Stieltjes transforms (see Proposition 2.1(v)), the 
subsequence {s^} converges uniformly on K to s(z), the Stieltjes transform 
of the measure to. This is incompatible with ( 4.40 ), because of the one-to-one 
correspondence between measures and their Stieltjes transforms. I 

Remark 1 Since the Stieltjes transforms of non-negative and normalized to 
unity measures are analytic and bounded for non-real z, we can replace the 
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requirement of their convergence for any z belonging to a certain compact of 
C± by the convergence for any z belonging to any interval of the imaginary axis, 
i.e. for z = iy,y € [yi, y 2 ], yi > 0. 



Remark 2 The arguments, used in the proof of the proposition prove also that 
if {m n } is a sequence of random non-negative measures converging weakly in 
probability to a nonrandom non-negative measure to, then the Stieltjes trans- 
forms s n of to„ and the Stieltjes transform s of m are related as follows 

lim E{sup \s n (z) - s{z)\} = (4.11) 

n^oo zeK 

for any compact K of C± . 



Lemma 4.1 Let H n be the random n x n matrix of the form (2.1) in which 
A and B n are random Hermitian matrices, U n and V n are random unitary 
matrices distributed each according to the normalized to unity Haar measure 
on U(n) and A n , B n , U n and V n are mutually independent. Assume that the 
normalized counting measures N r<n , r = 1, 2 of matrices A n and B n converge in 
probability as n — > oo to non-random non-negative unit measures N r ,r = 1,2 
respectively and that 



sup 1 1 Ai| | < T < oo, sup H-B-n.ll < T < oo. 



(4.12) 



Then the normalized counting measure of H n converges in probability to a non- 
random unity measure N whose Stieltjes transform f(z) is a unique solution 
of system (2. It) in the class of functions f(z), A r (z),r = 1,2 analytic for 
Im z and satisfying conditions (2.H) - (2.l\ ) and ^i.li ) 



Proof. In view of Proposition 4.1 it suffices to show that linin^oo E{|g ra (2:) - 
f{z)\\ — for any z belonging to a certain compact of C±. Moreover, according 
to Remark [l] after Proposition 
of the imaginary axis, i.e. to 



1.1 



we can restrict ourselves to a certain interval 



z = iy,y € [yi,3/a],0 < yi < y 2 < oo. 



(4.13) 



Since the condition (4.12) of the lemma implies evidently the condition ( p.l| ) of 
Theorem [O] and Theorem 3.2, all the results obtained in these theorems are 
valid in our case for any fixed realization of random matrices A and B n . In 
addition, all n-independent estimating quantities entering various bounds in the 
proofs of these theorems and depending on the forth moment in fl3.l[ ) and 
on yo will depend now on T and on yi and y 2 in (4.13), but not on particular 
realizations of random matrices A n and B n . We will denote below all these 
quantities simply by the unique symbol C that may have different value in 
different formulas. 
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In particular, denoting as above by (...) the expectation with respect to the 
Haar measure and using ( 3.42| ), we can write that 



E{|SnW" {9n(z))\} <E{K 1/2 (Z)|} <-. 

n 

Thus, it suffices to show that 

lim E{\(g n (z))-f(z)\}=0,z = iy, ye[yi,jfc], (4-14) 

n — >oo 

where y\ is big enough. Introduce the quantities 

7n(y) = -iy((9n{iy)} - f(iy)), IrAv) = ( s r,n(iy)) - A r (iy), r = 1, 2. (4.15) 
By using the second equation of system ( [2.18 ) we can write the identity 

ln{y) = iy[f2(iy - ti, n (y)) - f 2 (iy - h(y))] + e 1<n (y), (4.16) 



where 



£\.n{y) = iy[{9n{iy)) - h{iy - h, n (y))], 
*i,n(y) = -j — 7-tt, = 



(9n(iy)) 



f(iy) 



We have 



E{|ei, n (y)|} < 2/2E{|(g n (iy)) - ff 2 ,n(*J/ - *i,n(z/))|}- 
E{|ff2,n(«2; - - h(iy - h, n (y))\}- 



The analogues of ( 3.38 ) - ( 3.39 ) in our case are: 

(9n(z)) = 92,n( Z ~ ( <5 l,n( 2; )><3«( 2; )> _1 ) + h,n( Z )' 

where 

9-i,n{z) = n _1 TrG 2 (z) = 



(4.17) 
(4.18) 

(4.19) 

(4.20) 



X-z ' 

is the Stieltjes transform of random NCM iVjj.n of i?2,ra, 

ri,n(z) = -(gUzjn-'TrP-^g^z^Giz))- 
-{5l n {z)n^TrP-^{g n {z))- 1 G 2 {z)G{z)) 1 

the symbol (...) denotes the expectation with respect the Haar measure on U(n), 
P = l-G 2 {z)t 1<n (z), and 



9°n( z ) = 9n{z) ~ (g n (z)), 5° (z) = 5 1<n (z) - (Sl <n (z)) 



(4.21) 



are the respective random variables centralized by the partial expectations with 
respect to the Haar measure. In addition, we have the analogue of (3.45) 



In,„(z)| < -. 

n 
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This leads to the following bound for the first term in the r.h.s. of ( pL19| ): 

E{|(ffn(*v)> - 9iAw - t2, n (y)\] < E{|n, n (zy)|} < -. 

n 

To show that the second term also vanishes as n — > oo, we use the analogues of 
and (HI) 



{giAw)) + — 

iy 



T T 
< — , &,„(*!/) < -, 



which imply that 



|*l,n(»)| < 2T, 



(4.22) 



if yi is big enough. Thus 



E{|fl 2 ,n(ij/ - - /a(iy - *i,n(s/))|} < sup E{| ff2 , n («2/ + C) - /i(*J/ + Oil- 

|C|<T 

The r.h.s of this inequality tends to zero as n — > oo in view of the hypothesis 
of Theorem 2A and Remark || after Proposition 4.1 . Thus, there exist < 
2/1 < 2/2 < oo such that for all y € [2/1,2/2], lini„_>oo E{|ei )7l (y)|} = 0. Anal ogous 
arguments show that ]im n ^> 00 E{|ff2,n(?/)|} = 0, where £2,n(2/) is defined in (4.17) 
and in (4.18) where the indices 1 and 2 are interchanged. Thus we have 



lim E{|e r , n (2/)|} = 0, r = 1,2. 



(4.23) 



Consider now the first term in the l.h.s. of (4.16). In view of ( |2.5| ) we can write 
this term in the form 

(S ) iy 

J(3n) / 

(4.24) 

where I2, &i and b\ are defined by formulas ( |3.15| ) and (3.16), in which we have 
to replace A' l7 A x , /' and /" by Ai, (5i in ) 5 / and (g n ) respect ively. Denote 
by $ = j = i the matrix defined by the l.h.s. of system ( 3.14 ) and by 

r = {Tj}!-! t he ve ct or wi th co mpone nts Ti = j n , T2 — 71, n , T3 — 72, n- Then 
we have from (|1|), ( fD| ) and ((h2j) 

E{|(#r) 1 |}<E{|e 1 , n |}. (4.25) 

Interchanging in the above arguments indices 1 and 2 we obtain also that 

E{|($r) 2 |} <E{|e 2 ,„|}. (4.26) 

Besides, applying to the identity G{z)(H\ +H2 — Z) — 1 the operation (n~ 1 Tr...) 
and subtracting from the result the third equation of system (2.18), we obtain 
the one more relation 



E{|($r) 3 |} = o. 



(4.27) 
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It follows from the proof of Proposition |3.3| that the matrix $ is invertible if 
yi is big enough. Denote by ||...||i the ('-norm of C 3 and by ||...|| the induced 
matrix norm. Then we have 

E{||r||i} < E{||*- 1 $r||i} < E 1 / 2 {||#- 1 || a }E 1 / 2 {||#r||?}. (4.28) 

It follows from our arguments above that all entries of the matrices $ and 
and all components of the vector T are bounded uniformly in n and in 
realizations of random matrices A n ,B n , U n and V n in (2.1). Thus we have 

3 3 

II*- 1 !! < £ \(*-%\ < c, < E l<M r b < c. 

These bounds and ( |4.25| ) - Q4.28[ ) imply that 

V{\\r\\i}<C^(E{\e 2 , n \} + E{\e 2 , n \})^. 



In view of (4.23) this inequality imply (4.14), i.e. the assertion of the lemma. I 



Now we extend the result of Lemma 4.1 for the case of unbounded A n and 
B n , having the limiting NCM's with the finite first moments. We will apply the 
standard in probability truncation technique, whose random matrix version was 
used already in 0, |§. 



Proof of Theorem 2.1. Without loss of generality we can assume that 

sup / |A|E{JVi,„(dA)} < mi < oo. (4.29) 

n J 

For any T > introduce the matrices and replacing eigenvalues A n and 
B n lying in ]T,oo[ by T and eigenvalues lying in ] — oo,— T] by —T. Denote 
by N^ n , r = 1,2 the NCM of and B%. It is clear that for any T > 
and r = 1,2, the sequence {-^T n } n >i converge weakly in probability to the 
measures as n — * oo, where are analogously defined via N r and have 
their supports in [—T,T], and that for each r = 1,2 the sequence {N^}t>i 
converge weakly to N r as T -> oo. Denote by Nj t , r = 1,2 the NCM of 
Hi = Hf n + Hl n = V*A^V n + U*Bj t U n . According to linear algebra, if 
M r , r = 1, 2 are two Hermitian n x n matrices, then 

rank(Mi + M 2 ) < rankA/i + rankAf 2 , (4.30) 

and if {/i r ,z}/Lii r — 1,2 are eigenvalues of M r , r = 1,2, then for any Borel set 
A e K 

S A} - #{ M2 j S A}| < rank(Af! - M 2 ). 
By using these facts we find that 

\N n (A) - Nl(A)\ < irank(ff„ - H T n ) < irank(A„ - A T n )+ 

+ irank(B„ - B T n ) < JV 1>n (R\] - T,T[) + N 2>n (M\] - T,T[), { ^ 1> 
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valid for any Borel set A e 1. As a result, the Stieltjes transform of N% 
and the Stieltjes transform g n of N n are related as follows: 



\gl(z) - g n (z)\ < — (N hn (R\] - T, T[) + N 2 , n (R\] - T, T[)) , 



hence 



E{|<£(«) - 9n{z)\} < (E{iVi, n (R\] - T,T[)} + E{A 2 ,„(M\] - T, T[)}) . 



(4.32) 



and 



lim E{JV r , n (R\] - T, T[)} < 1 - N r (] - T, T[) = o(l), T —> oo. 



Since the norms of matrices Hf and .ffj are bounded, the results of the 
Lemma 4.1 are applicable to the function g^iz), so that, in particular, for any 
non-real z it converges in probability as n — > oo to a function f T (z) satisfying 
the system 



f: 



f T (z) 
AUz) 



2 1 " / T (< 



f T (z) 
f T (z) 

— z 

In addition, since E{g^(z)} and E{^^ ra (z)} are bounded uniformly in n and T 
for z G £?(y ) : 

|E{ 5 J(z)}| < 



E{<5?»}| <j-J |A|E{A^„(dA)} < i / |A|E{AMdA)} < ^ 



we have 



yo 



\f(z)\<±, |Af(z)|<"' ! 



(4.33) 



Thus, there exists a sequence 71- — > oo such that sequences of analytic functions 
{/ Tfc ( z)j and {Aj*(z)} converge uniformly on any compact of the E(yo) of 
(4.32). In addition, the measures N^,r = 1,2 converge weakly to the limiting 



measures N r ,r = 1,2. Hence, there exist thre e analytic functions f( z), A i(z) 
and A 2 (z) = zf(z) + 1 — A\{z) verifying ( 2.18 ). Besides, because of ( 1.35 ) and 
( j3?l| ) for z E E(yo) we have 

771 1 

|Ai(z)| < — , and A 2 (.z) = o(l) as yo — * oo. 

yo 

As a result of re lations above, f(z) and A r (z),r = 1,2 satisfy the conditions of 
Proposition 3.2, hence they are defined uniquely. 
Furthermore, we have 



E{| 5 „(z)-/(z)|}<E{|.g n (z)-.g^(^)|} + E{|^W-/ Tfe WI} + l/ Tfc W-/WI- 
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Hence in view of (4.32), arguments above on convergence of f Tk to / , and 
Lemma 4.1 we conclude that for each z € E(yo) 



lim E{\g n (z) - f(z)\} = 0. 



In view of Proposition 4.1 this implies that the NCM (2.2) of random matrices 
(|2.l|) converges weakly in probability as n — > oo to the non-random measure, 



whose Stieltjes transform is a unique solution of system ( 2. IS ) 



5 Properties of the Solution 



Here we will consider several simple properties of the limiting eigenvalue count- 
ing measure described by Theorem 2.1, i.e. the measure, whose Stieltjes trans- 
form is a solution of ( 2.18| ) satisfying ( p,12 )-(2.14). We refer the reader to works 
[ p2| ||, |], [| and references therein for a rather complete collection of results on 
properties of the measure, resulting from the binary operation in the space of 



the probability measures, defined by a version of system (2.18). This binary 
operation is called free additive convoluton. 



(i) Assume that the supports of the limiting eigenvalue measures of the ma- 
trices A n and B n are bounded, i.e. there exist — oo < a Tt b r < oo,r = 1,2, such 
that 

supp N r C [a r , b r ],r — 1, 2. (5.1) 



Then 



supp N C [ai + a 2 , h + 6 2 ] • 



(5.2) 



Proof. Denote by {A;}p =1 and by {X r j}f =1 ,r = 1,2 eigenvalues of H n and 
H r n in (2.1) respectively. Then, according to the linear algebra (cf.(4.31)), 



e R\[oi + 02, 61 + b 2 }} < #{\ u e R\[oi, 61]} + #{A 2 , Z G R\[o 2) b 2 }}. 



In view of Theorem 2.1 and ( J5.l| ) this leads to the relation N(W\a) = 0, i.e. to 
(0)- 



(ii). Examples. 1. Consider the case when A n —B n , i.e. Ni — N 2 . In this 
case system (2.18) will have the form 



f(z) = h 



(5.3) 



Take Ni — N = a So + (1 — a) S a where 0<a<l,a>0 and 5\ is the unit 
measure concentrated at A e 1. Then 
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and (2.18) reduces to the quadratic equation 

z(z ~ 2a) f + 2a(l - 2a) f -1 = 0, 
whose solution satisfying Q2.12| ) - ( p. 14 ) is 



f, \ -a(l - 2a) - y/(z - A + )(z - A_) r— 

/(z) = — , A± = a(l ± 2V« 1 - a)). 

z(z — 2a) 

By using ( 2.15| ) we find that the limiting measure in this case has the form 

N={2a-l) + S + (l-2a) + S 2 a + N*, (5.4) 
where x + — max(0,x), and 



is the absolute continuous measure of the mass I— 2a. Here xa(A) is the indicator 
of the set Act. In the cases a = 0, 1 (5.4) is 5 2 a and 60 respectively, and in 
the case a = 1/2 ( |5.4|) has no atoms, but only the square root singularities 



iV*(dA) = 



Formulas (p.3D-(|5.6|) shows that 



ityj A(2a — A) 



X[0,2a](A)dA 



(5.6) 



• the result (5_^2) is optimal with respect to the endpoints of the measures 
N r: r = 1,2 and N; 

• in the case when Ni = N2 have atoms of the mass /i > 1/2 at the same 
point then the measure N has also an atom of the mass (2/i — 1) (for 
general results of this type see j| ) . 



However, in general the support of N is strictly included in the sum of 
supports of measures N r ,r = 1,2, i.e. the inclusion in the r.h.s part of (5.3) is 
strict. This can be illustrated by the following two examples. 

2. Take again Ni = N 2 , where now 

NxidX) = 1 Y[-a, a] (A)dA. 

ny'a z — \ z ) 



is the arcsin law. This measure corresponds to the matrix ensemble (2.37) with 
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In this case equation (5.3) is again quadratic and leads to 



3. In the next example we take 



N r (dX) 



4^2 V 8 «? - A2 X[-2v^2o.,2,V2a r ] ( A ) dA > r = 1 >'- 



i.e. the both measures are the semicircle laws ( 2.31 ). Then it is easy to find 
that ./V is also the semicircle measure with the parameter a 2 = a 2 + a 2 .. This 
case was indicated in pQ] , It can be easily deduced from the law of addition 
of the R-transforms of Voiculescu because in this case R r (f) = 2a 2 . f '. For 
further properties of the measure N in the case when one of iV r , r = 1, 2 is the 
semicircle law see |l4], || . 

(iii). Suppose that one of the measures N r (dX),r = 1,2 is absolute continu- 
ous with respect to the Lebesgue measure, i.e., say, iVi(dA) = pi(A)dA, and 

~P\= ess sup \pi (A)| < oo,. 
AeR 

Then N is also absolute continuous with respect to the Lebesgue measure, 
i.e.N(dX) = p(A)dA, and 



ess sup |pi(A)| = p x < oo. 



(5.8) 



Proof. Indeed, since the function z\ — z — &-2,i/ f{z) is analytic for non-real 
z, the number of its zeros in any compact of C\R is finite. Thus, for any AeR 
there exists a sequence {z n } of non-real numbers such that z n — » A as n — > oo 
and Im z* ^ 0. Hence, we have from the first equation of system ( [2.18] ) for z* = 

A* + ie* 



I Im/(z) = I / £ rM^ 

tt it J (m-A*) 2 + (e*) 2 



1 

<PiZ 



(n K) 2 + ( £ *) 2 



Pi- 



This relation and the inversion formula (2.15) yield (5.8). For more general 
results in this direction see the recent paper []3|. 



6 Discussion 



In this Section we comment on several topics related to those studied above. 

1. In this paper we deal with Hermitian and unitary matrices, i.e. we 
assume that the matrices A n and B n in (2.1) arc Hermitian and U n and V n are 
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unitary. It is natural also to consider the case of real symmetric A n and B n 
and orthogonal U n and V n . This case can be handled by using the analogue of 
formula (3.11) of the orthogonal group 0(n). Indeed, it is easy to see that this 



analogue has the form 



$'(0 T MO) • [X,0 T MO]dO = 0, 



where O t is the transposed to O and X is a real symmetric matrix. By using 
this formula we obtain instead of (|3.23| ) 

(G aa (H 2 G) bc ) + (G ab (H 2 G) ac ) = ((GH 2 ) aa G bc ) + ({GH 2 ) ab G bc ). 

The second terms in both sides of this formula give two additional terms 

-n- 1 G T H 2 G + n~ 1 H 2 G T G. 



in the analogue of ( 3.40| ). These terms, however, produce the asymptotically 
vanishing contribution because, in view of (3.3), (BJi) and (3.37), we have 



! (Tr(l + A 2in f- 1 Gi)- 1 Gi(-G T H 2 G + H 2 G T G)) \ < 



1/4 



Similar and also negligible as n — > oo terms appear in analogues of formulas 
fl3~53[ ), ( pSS| ) and (|7|) of the proof of Theorem [T^. As the result, we obtain in 
this case the same system ( 2.18| ), defining the Stieltjes transform of the limiting 
eigenvalue counting measure of the analogue of ( p.l| ) with the real symmetric 
A n and B n and orthogonal Haar-distributed U n and V n ■ 



2. As was mentioned in the Introduction, our main result, Theorem 2.1 
can be viewed as an extension of the result by Speicher p7] , obtained by the 
moment method and valid for uniformly in n bounded matrices A n and B n in 
(EJ) . Both results are analogues for randomly rotated matrices of old results of 
JL Tf, p0{ (sec (2.24) and (2.33)) on the form of the limiting eigenvalue counting 
measure of the sum of an arbitrary matrix and certain random matrices (see 
(2.20) and (2.26)), in particular, Gaussian random matrices ( |2.28 ). In this case, 
however, there exists another model, proposed by Wegner ]33[ that combines 
properties of random matrices, having all entries roughly of the same order, 
and of random operators, whose entries decay sufficiently fast in the distance 
from the principal diagonal (see e.g. p3t). A simple, but rather non-trivial 
version of the Wegner model corresponds to the selfadjoint operator H acting 
in l 2 (Z d ) x C" and defined by the matrix 



H(x,j;y, k) = v(x - y)5 jk + 5{x - y)fjk{x) 



(6.1) 



where x, y S Z d , j, k = 1, n, 5(x) is the ci-dimensional Kronecker symbol, 



u(— x) — v(x), 



(6.2) 
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and f(x) — {fjk{x)}™ k=1 , x & Z d are independent for different x and identically 
distributed n x n Hermitian matrices, whose distribution for any x is given by 
( p. 28 ). According to |33j (see also [H]) asymptotic for n — > oo properties of 



operator (6.1) resemble, in many aspects, asymptotic properties of matrices 
( p. 28 ). The "free" analogue of the Wegner model was proposed in |L9]]. In this 



case i.i.d. matrices f(x) have the form 

f(x) = U*(x)B n U n (x) (6.3) 



where B n is as in (2.1) and U n (x), x S 7L d are i.i.d. unitary n x n matrices 
whose distribution is given by the Haar measure on U (n). By using a version of 
the moment method, similar to that of paper p7fl , or, rather, its formal scheme, 
the authors derived the limiting form of 

where G(x, j\ y, k) is the matrix (the Green function) of the resolvent {H — z) 



of (6.1) - (6.3). The authors also found a certain second moment of the Green 
function. This moment is necessary to compute the a.c. conductivity via the 
Kubo formula. Because of the moment method results of [19| are valid for 



uniformly bounded in n matrices B n in fl6.q), similar to results for matrices 



(2.1) obtained in |27J . By using a natural extension of the differentiation formula 
(3.11) and the technique developed in [y| to analyze the Wegner model, the 



results of paper Jl9| can be extended to the case of arbitrary matrices B n in 



(3.2), because in this case the role of condition (2.17) of Theorem 2.1) plays 



condition (6.2) 



3. As was mentioned before asymptotic properties of random matrices are 
of considerable interest in the certain branches of the operator algebra theory 
and related branch of the non-commutative probability theory, known as free 
probability (see j2^, B2|, |3lJ] and references therein). Here large random matrices 
is an important example of the asymptotically free non-commutative random 
variables, providing a sufficiently reach analytic model of the abstract notion of 
freeness of elements of an operator algebra. The most widely used examples of 
asymptotically free families of non-commutative random variables are Gaussian 
random matrices and unitary Haar-distributcd random matrices. The proof of 
asymptotic freeness of unitary matrices given in [p9| , |32]| reduces to that for 
complex Gaussian matrices basing on the observation that the unitary part of 
the polar decomposition of complex Gaussian matrix with independent entries is 
the Haar-distributed unitary matrix. This method requires certain technicalities 
because of the singularity of the polar decomposition at zero. On the other hand, 



the differentiation formula (3.11) allows one to prove directly similar statements. 



Here is an example of results of this type (related results are proved in [p6|). 



35 



Theorem 6.1 Let k be a positive integer, {T ri „}^ =1 be a set of n x nmatrices, 
such that 

sup n- 1 Tr(T r * n r r , n ) z < oo, (6.4) 

r<k: k,l,n£fi 

and let U n be the unitary and Haar- distributed random matrix. If for any k G N 
lim nT TrT rn = 0, r = 1, fe, (6-5) 

n — >oo 

then for any set of non-zero integers such that {m r )y_ 1; X)r=i m r = 

lim (n- 1 TrU , n ni T hn ...U™*T k , n ) = 0, (6.6) 

n — >oo 

where (•) denotes the integration with respect to the Haar measure over U(n). 

Remark 1 The theorem is trivially true in the case when ., m r 7^ 0. 

In the two subsequent lemmas we omit the subindex n. 

Lemma 6.1 Let {Ti}^ =1 be a set ofnxn matrices and U is the Haar- distributed 
unitary matrix. Then for any set of non-zero integers {rni}^ =1 , Yli=i m i = 
the following identity holds: 

m 1 

n- lr Vr{U mi T 1 ...U mk T k ) = - ^(7J- 1 Tr^ ^1 - 1 n- 1 Tr([/" ll - ^1 + 1 Tl...^ mfc T fc ))- 
^l=2 

Y Y (n~ 1 Tr(U mi T 1 ...T r - 1 U l r- 1 )n- 1 Tr{U m r- l r +1 T r ...U mk T k )) + 

r£{2,...,fc},ro r >0 (,.=1 

(6.7) 

Y Y {^ 1 ^{U mi T 1 ...T r ^ 1 U- lr )n- 1 TY{U m ^T r ...U mk T k )). 

re{2,...,fc},nv<0 i r =l 

Proof. Without loss of generality assume that mi > 0. Then, using the 



analogue of formula (|3.1l| ) for the average ([£/ mi Ti...£/ mfc Tfc] a b), we obtain for 
any Hermitian X 

Y J2 ([U mi T 1 ...T r ^ 1 U h - 1 XU mr - lr+1 T r ...U mk T k } ab ) + 

r€{l,...,k},m r >0 lr=l 
— m r 

Y Y^ umiTi --- Tr - iU ~ lrXumr+lrTr --- umkTk ^ = ( 6 - 8 ) 

r£{2,...,fc},ro r <0 i r =l 

Choosing as X the Hermitian matrix having only (c, e?)-th and (d, c)-th non-zero 
entries, setting then a = c and b — d and applying to the result the operation 



; S a 6' we obtain (6.7) 
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Lemma 6.2 Under the conditions (6.4) and ( \6.{\ ) the variance D = (|£°| 2 ) of 
the random variable 



£ = n-^rL, L = U mi Tj ...U m " T k 
is of the order n~ 2 as n — > 00. 



(6.9) 



Proof. Using the same technique as that in Lemma 3.1 for (L a bL cc [) we 
obtain the relation 



D = - ^{i n- lr IrU ll - 1 n- 1 Tr{U mi - ll+1 T l ...U mk T k ))^ 



h=2 



Yl ^^ 0?i_lTr (^ miTi --- rr - i ^ r_1 ) n_lTr ( c/mr_ ' r+l71 '---- c/mfcTfe )) H 

r6{2,...,fc},m r >0 l r = l 

(6.10) 

— m r _ 

E E n- lr TY(U mi T 1 ...T r ^ 1 U- l -)n- 1 Ti(U m - +l -T r ...U mk T k )) 

re{2,...,fe},m r <0 (r=l 

where 

$ = - J2 n~ 1 Tr({U mr - lr+1 T r ...T k U mi T 1 ...T r - 1 U l '- 1 yL) + 

r<E{l,...,fc},m r >0 'r = l 



+ Y n- 1 Tr((U m " +lr T r ...T k U mi T 1 ...T r - 1 U- lr )*L). 

r£{2,...,k},m r <0 l r = l 

We have obviously for fc = m = 1 



(n- i Tt([m o n" i Tr(L/T)) < — n~ ir Tr(TT*). 



We proceed further by induction. In view of condition (6.4) and Proposition p.l| 
we have the bound 



-iTr(C7 roi T ri ...U m »T r )\ < C 2 



(6.11) 



where C may depend only on p. N ow, since n lr Tr({7 ) = 0, 1 7^ 0, the summands 
of the first term in r.h.s. of ( |6.1C| ) can be estimated as follows 



(e°n- 1 Tr([/' 1 )^ 1 Tr(C/ mi ^ il+1 r 1 ...C/ mfc T fc )) < CVB^J ^(|n- 1 Tr([/'i)°| 2 ) . 

(6.12) 
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Likewise, by using the cyclic property of the trace, the identity (a°bc) — (a°b°c} + 
(a°c°)(b), Schwarz inequality, and (6.11), we obtain for the second term in the 
right-hand side of ( |6 .10 ) the following estimates for r > 2 



(t\- 1 Tr{U mi T 1 ..T r - 1 U lr - 1 )n- 1 TY(U m r- l '~ +1 T r ...U mk T k )) 
< CVD { y /(\n- 1 Tr(U m i+ t r- 1 T 1 ...U m r-iT r „ 1 )°\ 2 )+ 
+ ^{\n- 1 Tr{U m -- l r+ 1 T r ...U m KT k )°\ 2 )} 



< 



(6.13) 



The third term in the right-hand side of ( 6.10|) c an be estimated analogously. 
The forth term is of the order 1 / n 2 in view of fl6.9| ) . By the induction hypothesis 
the expectations under square roots in the r.h.s. of ( |6 .13 ) and Q6.12 ) are of the 
order rtT 2 . This leads to the inequality 

n n z 

where C\ and Ci are independent of n. This implies the bound D = 0(n~ 2 )M 

and again the induction. We have 



Proof of Theorem 



6.1. We use Lemma 3.1 



first 



- lr Tr(U m TiU~ m T 2 ) = n _1 TrTi7i _1 Trr 2 = 0. 



In general case we use Lemma [T^ to factorize asymptotically the moments in the 
r.h.s. of (|6~7|). In the resulting relation the expressions n -1 Tr(t/ mr i T ri ...U mr ° T Tg ] 
are zero for any collection (T ri , T r3 ) and any n, if Y]1—i fn Ti i= 0, and tend 
to zero as n — > oo if 2l=i m ri — m view of the induction hypothesis and 
condition (6.5). This leads to 

Remark 2 A simple version of the above arguments allows us to prove that the 
normalized counting measure of the Haar distributed unitary matrices converges 
with probability one to the uniform distribution on the unit circle. Indeed, 
consider again the Stieltjes transform g n of this measure, supported now on the 
unit circle. By the spectral theorem for unitary matrices we have 

g n {z) = n- lr TrG(z), G{z) = (U - z)~\ \z\ + 1. (6.14) 

We can then obtain the following identities 

(TrG 2 (z)U) = 0, (g n (z)n- 1 TrG(u)U) = 0, (6.15) 

(<?„(2i)^ 1 TrG(zi)[/.g(z 2 )) + (n- 3 TiG(z 1 )G{z 2 )UG(z 2 )) = 0. (6.16) 
By using the obvious relations 

G'{z) = G 2 (z), G(0) = U-\ G(oo) = 0, 



we obtain from the first of identities ( 5.15 ) 

fn(z) = (g n (z)} 



\Z\<1, 

\z\>l. 
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This relation shows that the expectation of the normalized counting measure of 
U is the uniform distribution on the unit circle, the fact that follows easily from 



the shift invariance of the Haar measure. Now the second identity (6.15) and 
( |6.16 ) lead to the bound 



\{9n(z))\*<^, \z\<r , 
where C(r*o) is independent of n and finite if ro is small enough. This bound 



and arguments analogous to those used in the proof of Theorem 3.1 imply that 
the normalized eigenvalue counting measure of unitary Haar distributed random 
matrices converges with probability one to the uniform distribution on the unit 
circle. This fact as well as the analogous fact for the orthogonal group can be 
deduced from the works by Dyson (see e.g. fllql ), where the joint probability 
distribution of all n eigenvalues of the Haar distributed unitary or orthogonal 
matrices was found and studied. This technique is more powerful but also more 
complex than that used above and based on rather elementary means. 
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